Early and Late Beta Band Power reflect Audiovisual Perception in 1 the McGurk Illusion
نویسندگان
چکیده
33 The McGurk illusion is a prominent example of audiovisual speech perception and the influence, visual 34 stimuli can have on auditory perception. In this illusion a visual speech stimulus influences the 35 perception of an incongruent auditory stimulus resulting in a fused novel percept. In this high-density 36 electroencephalography (EEG) study we were interested in the neural signatures of the subjective 37 percept of the McGurk illusion as a phenomenon of speech-specific multisensory integration. 38 Therefore, we examined the role of cortical oscillations and event-related responses in the perception 39 of congruent and incongruent audiovisual speech. We compared the cortical activity elicited by 40 objectively congruent syllables with incongruent audiovisual stimuli. Importantly, the latter elicited a 41 subjectively congruent percept: the McGurk illusion. We found that early, event-related responses (N1) 42 to audiovisual stimuli were reduced during the perception of the McGurk illusion compared to 43 congruent stimuli. Most interestingly, our study showed that a stronger post-stimulus suppression of 44 beta band power (13-30 Hz) at short (0-500ms) and long (500-800ms) latencies during the perception 45 of the McGurk illusion compared to congruent stimuli. Our study demonstrates that auditory perception 46 is influenced by visual context and that the subsequent formation of a McGurk illusion requires 47 stronger audiovisual integration even at early processing stages. Our results provide evidence that 48 induced beta band suppression at early stages reflects stronger stimulus processing in the McGurk 49 illusion. Moreover, stronger late beta band power suppression in McGurk illusion indicates the 50 resolution of incongruent physical audiovisual input and the formation of a coherent, illusory 51 multisensory percept. 52
منابع مشابه
Early and late beta-band power reflect audiovisual perception in the McGurk illusion.
The McGurk illusion is a prominent example of audiovisual speech perception and the influence that visual stimuli can have on auditory perception. In this illusion, a visual speech stimulus influences the perception of an incongruent auditory stimulus, resulting in a fused novel percept. In this high-density electroencephalography (EEG) study, we were interested in the neural signatures of the ...
متن کاملAlpha-Band Oscillations Reflect Altered Multisensory Processing of the McGurk Illusion in Schizophrenia
The formation of coherent multisensory percepts requires integration of stimuli across the multiple senses. Patients with schizophrenia (ScZ) often experience a loss of coherent perception and hence, they might also show dysfunctional multisensory processing. In this high-density electroencephalography study, we investigated the neural signatures of the McGurk illusion, as a phenomenon of speec...
متن کاملOn the variability of the McGurk effect: audiovisual integration depends on prestimulus brain states.
The McGurk effect demonstrates the influence of visual cues on auditory perception. Mismatching information from both sensory modalities can fuse to a novel percept that matches neither the auditory nor the visual stimulus. This illusion is reported in 60-80% of trials. We were interested in the impact of ongoing brain oscillations-indexed by fluctuating local excitability and interareal synchr...
متن کاملFace configuration affects speech perception: Evidence from a McGurk mismatch negativity study
We perceive identity, expression and speech from faces. While perception of identity and expression depends crucially on the configuration of facial features it is less clear whether this holds for visual speech perception. Facial configuration is poorly perceived for upside-down faces as demonstrated by the Thatcher illusion in which the orientation of the eyes and mouth with respect to the fa...
متن کاملWhat is the McGurk effect?
McGurk and MacDonald (1976) reported a powerful multisensory illusion occurring with audiovisual speech. They recorded a voice articulating a consonant and dubbed it with a face articulating another consonant. Even though the acoustic speech signal was well recognized alone, it was heard as another consonant after dubbing with incongruent visual speech. The illusion has been termed the McGurk e...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015